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SYSTEM AND METHOD FOR REMULTIPLEXING 
OF A FILTERED TRANSPORT STREAM WITH 
NEW CONTENT IN REAL-TIME 



5 



BACKGROUND OF THE INVENTION 



Field of the Invention 



This invention relates generally to digital delivery systems, especially for digital video and 
digital audio data, and more specifically, to a transport stream demultiplexor system including 
10 real-time packet remultiplexing function. 



In an MPEG subsystem that receives content in transport stream format, a transport 
15 demultiplexor is used to separate the arriving stream into audio, video, and system data streams. 
The video data is sent to the video decoder, the audio data to the audio decoder, and the system 
data to system memory for further processing. In a set-top box application, this allows the 
program selected by the viewer to be separated and played. 

20 Increasingly, there is a need to be able to store selected program(s) to a fixed storage device such 
as a hard drive for playback in the set-top box. This requires sending all data associated with the 
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program; audio, video, and system data, to memory for subsequent transfer to the hard drive or 
other device. 

Previous disclosed techniques for storing and playing data based on using the PES, or Packetized 
Elementary Stream, format which allows for efficient content movement is described in 
commonly-owned, co-pending U.S. Patent Application Nos. 09/534643, 09/535069, and 
09/535001 the contents and disclosure of each of which are incorporated by reference herein. 



However, an alternative of interest to system designers is to store the data in its original transport 
stream format, but filtering out packets that are not related to the program of interest. When 
doing this, it may be necessary to insert additional packets containing further information into the 
partial transport stream as it is being stored to allow subsequent playback. In fact, the ability to 
add information to a stored stream may be generally used to add or modify stream information 
for a variety of purposes. 

Prior art methods for multiplexing "on the fly" require large and complex buffering schemes for 
the original stream and dedicated processing resources. Another prior art method as described in 
a data manual to TSB42AA4/TSB42AB4 (ceLynx) Texas Instruments (TI) Data Manual, pp. 
4_1 1-413, June 2000, relates to a packet insertion method that implements a fixed size data 
buffer comprising data that inserts packets in gaps of a transport stream, however, relies on the 



END920000139US1 



2 



G:\work\l 1 10\13949\spec\13949.spc 

system microprocessor to write the individual data bytes in the buffer. Thus, the TI device is not 
capable of inserting multiple continuouspack ets in t he transport stream. The TI system 
furthermore implements a trial and error approach for inserting packets. That is 5 the signaling 
mechanism employed in the TI device detects any gap in the data stream with no guarantee that 
the detected gap will be able to hold a full packet's worth of data. Thus, if a detected gap in the 
stream is being filled and there is not enough space for a full packet insertion, then the TI device 
abandons the insertion as if it never took place. 

It would be highly desirable to provide in a digital data transport demultiplexer, a system and 
method for reaMime^ i.e., inserting, packets including new content with a filtered 

transport stream as it is being forwarded to another device on a real-time basis. 

It would be further highly desirable to provide in a digital data transport stream demultiplexer, a 
system and method for inserting in the transport stream multiple continuous packets including 
new content, in real-time, wherein the packets are retrieved directly from a system memory 
storage device. 

It would additionally be highly desirable to provide a remultiplexing technique for inserting new 
packets in a transport stream, without requiring large and complex buffering schemes and 
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without using dedicated processing resources, so that remultiplexed program content may be 
communicated in real-time to a subscriber location for viewing or display. 

It would additionally be highly desirable to provide in a real-time remultiplexing device capable 
5 of inserting, packets including new content in a filtered transport stream as it is being forwarded 
to another device on a real-time basis, a mechanism for guaranteeing the presence of available 
gaps in the filtered stream that are capable of receiving a full length packets. 



It is an object of the present invention to provide in a digital data transport demultiplexor, a 
system and method for real-time remultiplexing, i.e., inserting, packets including new content 
with a filtered transport stream as it is being forwarded to another device on a real-time basis. 

15 It is a further object of the present invention to provide in a digital data transport stream 

demultiplexor, a system and method for inserting in the transport stream multiple continuous 
packets including new content, in real-time, wherein the packets are retrieved directly from a 
system memory storage device. 
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It is another object of the present invention to provide a real-time remultiplexing technique for 
inserting new packets in a transport stream, without requiring large and complex buffering 
schemes and without using dedicated processing resources, so that remultiplexed program 
content may be communicated in real-time to a subscriber location for viewing or display. 

5 

It is yet another object of the present invention to provide in a real-time remultiplexing device 
capable of inserting, packets including new content in a filtered transport stream as it is being 
^ forwarded to another device on a real-time basis, a mechanism for guaranteeing the presence of 

•at r 
; ?1 

\] available gaps in the filtered stream that are capable of receiving a full length packets. 

W 

U 10 

.S3 L 

j "! According to the invention, there is provided in a transport stream demultiplexer device 

j Si i. receiving an input transport stream comprising a plurality of data packets and including a filter 

in 

O device for removing one or more predetermined packets to form a partial transport stream, a real- 

m 

;;;f time data remultiplexing system comprising: a device for detecting presence of a gap in the 
15 partial transport stream where predetermined packets have been removed and generating a signal 
indicating the gap location; a device for directly retrieving packet data having new content from a 
memory storage device, and storing the retrieved packet data into a staging buffer device for 
queued storage prior to insertion into the partial transport stream; and, a multiplexor device 
responsive to the flag for pulling a queued data packet from the staging buffer device and 
20 inserting the pulled packet into the gap as the partial transport stream is being transported on a 
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real-time basis. The retrieving device enables concurrent re- filling of the staging buffer as 
queued data is pulled from the buffer so as to enable re-multiplexing of high bandwidth/high data 
content streams. 

5 Advantageously, such a system and method is adapted for processing MPEG-2-compliant digital 
transport streams, however, may be applicable to other types of digital data communications. 
Moreover, given that the re-multiplexing mechanism is provided with intelligence for enabling 
automatic retrieval of data contents directly from the system memory, the degree of data 
movement is reduced, thus enabling re-multiplexing of high bandwidth/ high data content 



Further features, aspects and advantages of the apparatus and methods of the present invention 
15 will become better understood with regard to the following description, appended claims, and the 
accompanying drawing where: 

Figure 1 is a block diagram illustrating the transport demultiplexer 10 adapted for demultiplexing 
a digital transport stream and including the real-time remultiplexor component according to the 
20 invention. ' 



10 



streams. 



Brief Description of the Drawings 



END920000139US1 



6 




G:\work\l 1 10\13949\spec\13949.spc 



Figure 2 illustrates a detailed block diagram depicting the data flow operations for the real-time 
data remux component 50 according to the invention. 



According to the invention, there is provided a technique for inserting, or remultiplexing, packets 
containing new content with a filtered transport stream as it is being stored to memory for 
subsequent filing on a fixed storage device. The technique is based on a modification to the 
10 existing transport demultiplexor as described in commonly-owned, co-pending United States 
Patent Application Serial No. 08/938,248 entitled TRANSPORT DEMULTIPLEXOR FOR AN 
MPEG-2 COMPLIANT DATA STREAM the contents and disclosure of which is incorporated 
by reference as if fully set forth herein. 

15 Particularly, the demultiplexor described in United States Patent Application Serial No. 

08/938,248 is a transport demultiplexor that is adapted for demultiplexing an MPEG-2-compliant 
transport stream into system data streams, a video data stream, and an audio data stream 
particularly, by extracting program clock references (PCRs) from the data stream and filtering 
out unnecessary components through the use of Packet Ids (PIDs). As shown in Figure 1, the 

20 transport demultiplexor 10 includes front end logic 15, back-end logic 20, and including a packet 
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buffer 21, control circuit 25, and a data unloader 26, video unloader 27, and audio unloader 28. 
Generally, the front end logic 15 receives transport stream input packets, and delivers the 
transport stream packets to the packet buffer 21. The packet buffer 21, in turn, delivers system 
data to the system data unloader 28, video data to the video unloader 26, and audio data to the 
audio unloader 27 each of which, as will be explained, asynchronously pull packets out of the 
packet. 



A typical system incorporating the transport demultiplexer of the invention includes a front-end 
demodulator device (not shown) that converts a received analog signal (e.g., from a satellite 

10 broadcast), into a multiplexed digital data (transport) stream which arrives at an input port 1 1 as 
188 byte packets, each packet having a repeating character that may be used for synchronizing 
packet boundaries. This synchronization is performed by a synchronizer device 12 which 
receives the 188 byte packet input . Once the packet boundaries are known, the packets are input 
to the packet parser device 13 which looks at the different data fields within a packet header. As 

15 known, the packet header includes a packet identifier, i.e., a PID, which is used to reassemble the 
original components of the stream of data, i.e., video, audio, etc. Included in the packet parser 13 
is a PID filter 14 which functions to filter out the unnecessary packets from the input multiplex 
stream and pass through only those packets associated with the desired data, e.g., video or audio 
program, for example. Additionally, the packet parser extracts program clock references (PCRs) 

20 and sends them to a clock recovery unit 19 for reconstructing a System Time Clock (STC). 
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From the PID filter 14, the desired packets may be optionally input via an interface 16 to a 
descrambler device 16a which may be implemented for conditional access reasons. The data 
may then be transferred to an auxiliary port 1 7 for exit as a real-time stream 40, i.e., the data that 
arrives at the front end 1 5 leaves the front end at the same rate. The difference however, is that 
5 the output is reduced to only the packets that are of interest for communication on a real-time 
basis. 

As described in commonly-owned, co-pending U.S. Patent Application Serial No. 

entitled SYSTEM AND METHOD FOR REMULTIPLEXING OF A FILTERED TRANSPORT 

10 STREAM [END920000140US 1 , Atty Dckt. #1 3950], the output stream is additionally input to a 
packet loader device 18 which may transport the packets through the buffer control device 25 for 
loading into a packet buffer 2 1 , which may be a ten ( 1 0) packet bucket, for example. As 
mentioned, the PID filter 14 enables retention of only the packets of interest however, this data 
has not been separated. Preferably, a key word or an information word has been is associated 

15 with each packet which identifies the packet as either audio, video or data headed for system 
memory. Thus, loaded into the packet buffer are all the packets of interest with each packet 
having an information word appended thereto indicating the payload and dictating the subsequent 
processing to be performed by the video, audio and data unloaders. This processing includes 
transferring packets associated with one program, e.g., audio data, video data and 

20 navigation/system data associated only with that program, in a "bucket queue" memory for 



END920000139US1 



9 



• 



G:\work\l 1 10\13949\spec\13949.spc 

subsequent access including decoding and playback. That is, the special controls in the data 
loader 28 and the buffer control 25 enable the video, audio and system data to be stored together 
in one place, the bucket queue, rather than separate places. More particularly, as described in co- 



5 1, provides a queue remux component 100 which performs a packet insertion function enabling 
new data content to be subsequently inserted for storage in the bucket queue that was not in the 
original stream. As shown in Figure 1, this queue remux component 100 is provided as part of 
the data unloader module 28. 

10 In accordance with the present invention, the alternative to remultiplexing new data content for 
programs that are to be stored in a bucket memory for subsequent access, is to remultiplex 
("remux") new data content into the partial transport stream to be communicated on a real-time 
basis A Since the stream 40 maintains its real-time characteristics, there is no inherent way to 
directly insert new packets, i.e., the CPU does not have time to be able to go in and add new 

15 content. However, due to the filtering out of unnecessary content by the demultiplexor PID filter 
14 which removes packets in their entirety, thereai€j^s>pre ated in th e original transport stream 
whichjriay be inserted wit^ eg^ata^on^t withou t delay ing.or negatively affecting the real- 
time stream in any way. Thus, according to the preferred embodiment of the invention, a 
signaling mechanism is provided that is generated by the auxiliary port 17 that inform s a 

20 multiplexer component jwh ere the gaps exist so _that data mayjbe inserted therein. Since packets 



pending U.S. Patent Application Serial Nc. 
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are of fixed size, e.g., 188 bytes there is guaranteed to be sufficient space to, insert a full packet's 
worth of new data content in these gaps oTTpp ening s. Further, in accordance with the invention, a 
FIFO buffering function is provided that enables new packgt_d ata to be queued fo r insertion in 
the stream, and multiplexed into it when an empty packet slot is indicated. 

5 

It is understood that, the auxiliary port 17jdepicted in Figure 1, is compatible with the input port 
of real-time network transmission device such as a 1394 link controller (not shown) that includes 
support for the IEC61 883 standard, for example. In order to provide real-time packet insertion, 

□ 

\] the first component of the invention comprises the addition of a new Remux Buffer block 50 
Q 10 connected between the demultiplexer auxiliary port 1 7 and the 1394 real-time transmitter. As 
I" ■ will be described in greater detail, the Remux Buffer block 50 includes a staging buffer 

S3} 5 

i k1 component 52 that has a direct interface to system memory and is configured to retrieve a given 

p number of packets that have been created by a processor and placed at a certain^ddrcss in 

□ memory. The Remux Buffer block particularly fetches new packet data until the staging buffer is 

! I 

15 filled. As is understood, this must constitute at least one full packet worth of data in order to 
prevent starting to load a packet in a gap and not being able to complete fetching the data from 
memory in time. 

More particularly, as shown in Figure 1, the real-time Remux Buffer block is a logic device 50 
20 comprising a data multiplexor block 5 1 , the remux (staging) buffer 52 ( 1 394 Remux Buffer), and 
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a PLB (Processor Local Bus ) interface (IF) 53. The remultiplexor logic device 50 essentially 
receives new data content, e.g., pre-fabricated data built ahead of time by the CPU, from system 
memory, without CPU intervention, via the PLB/IF interface 53. The new content is queued up 



in the staging buffer 52 within the logic block. The auxiliary port sends a signal indicating 
5 where the gap exists in the transport stream. In response, the multiplexor block 5 1 moves the 
new data from the staging buffer (1394 remux buffer 52) and inserts the new data in the transport 
stream at the indicated gap. Simultaneously, the staging buffer is refilled directly from system 
memory. 

10 Referring in greater detail to Figure 2, the original transport stream 1 1 is input to the 

demultiplexer where the PID filter 14 pulls out only the packets cared about. Particularly, the 
auxiliary port generates two (2) pieces of information, including: 1) the partial transport data 
stream itself 40; and, 2) a gap indicator flag 55 for indicating the presence of a valid gap in the 
transport stream at the location(s) where a packet has been filtered out. The gap indicator flag 55 

15 provides a guarantee that there is 1 88 bytes space in the transport stream and ensures that a 

packet will not be inserted unless the entire packet (1 88 bytes) is available in the buffer. As it is 
a requirement that no more packets be inserted in the stream than are removed by the 
demultiplexer filtering operation, the Mux control block 61 receives the gap indicator flag 55 
from the auxiliary port and additionally receives a flag 56 indicating from the staging buffer 

20 indicating whether or not there is a packet's worth of available new data in the staging buffer for 
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input to the stream at the gap location. This mechanism ensures that the correct amount of new 
data will be input to fit the detected gap location. 

The staging buffer particularly includes a 188 byte storage tank or first-in-first-out (FIFO) unit 
5 62 which stores the new available data for immediate insertion into a determined gap of the 
transport stream as the real-time stream 40 is going by. A mechanism for keeping the FIFO 
buffer 62 full is provided which includes buffer control 63, address generator 64, and, the PLB 
interface 53 components. The buffer control device 63 and address generator 64 include devices 
retrieving the packets to be inserted directly from the system memory in accordance with a direct 

10 memory access protocol, and loading of the packets in the FIFO 62, That is, in response to a data 
request 67 from the FIFO 62, data is pulled directly from system memory so that when the FIFO 
starts to get empty during a packet insertion operation, more new data may be retrieved for re- 
filling the buffer. In this manner, continuous packets (or large data blocks) stored in memory 
may be inserted in the stream, if the transport stream permits. As shown in Figure 2, the CPU 

15 interfaces with the logic block 50, and only functions to inform the logic components 68 where 
that data to be inserted is, and how many packets there are. Particularly, information including 
the packet address in system memory where the packet data 70 to be inserted is, and its size 68, 
i.e., how many bytes the data to be inserted comprises, are communicated to the address 
generator block 64. This is because the CPU has constructed ahead of time the data packets to be 

20 inserted, and stores these in the system memory. Via a direct memory access protocol, the 
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address generator and buffer control blocks cooperate to control retrieval of the data bytes 
directly from system memory and inserts these in the buffer. As further shown in Figure 2, the 
address generator performs address generation for the next packet to be loaded in the FIFO and 
additionally, generates an interrupt 66 to the CPU when all data is loaded, i.e., when the 
5 remultiplexor function 50 has consumed all of the data. The data 75 stored in the FIFO is 
eventually inserted in the partial transport stream 40 by the data Mux 51 . 

According to the invention, the methodology for carrying out the transport demultiplxor queue 
remultiplexor function includes a first step of configuring the partial transport stream (with gaps) 

10 for delivery out of the auxiliary port of the demultiplexer by only indicating a subset of available 
packets are to be forwarded to the auxiliary port. It should be understood that packets may go to 
auxiliary port and/or the system memory for eventual reinsertion. Concurrently, or in advance, 
the CPU is constructing in memory the packet to be inserted. It should be understood that there 
is no correlation in time between these two events, i.e., these are independent processes. Once 

15 these steps are completed, the CPU configures the insertion function by giving the address 
generator block of the remux buffer the address of the new data and the number of packets for 
storage in the FIFO. Then logic is implemented for inserting data, at which time an interrupt is 
issued when all of the available data is loaded. It is understood that timer interrupts may be used 
for time spacing so that this may be repeated at regular intervals in order to intersperse the new 

20 



END920000139US1 



14 




G:\work\l 1 10\13949\spec\13949.spc 

data. That is, a timer interrupt, as is included in an integrated Set-Top chip such as the STB03xxx 
design, may be set so that packets are inserted on a periodic basis throughout the stream. 

While the invention has been particularly shown and described with respect to illustrative and 
5 preformed embodiments thereof, it will be understood by those skilled in the art that the 

foregoing and other changes in form and details may be made therein without departing from the 
spirit and scope of the invention which should be limited only by the scope of the appended 
claims. 



END920000139US1 



15 



